///?■£# 77ff- 73/ 


3 1176 01345 5341 


NASA Technical Memorandum 86731 


NASA-TM-86731 19850024806 


Qualification Needs for Advanced 
Integrated Aircraft 

Dale A. Mackall 


r, 


7 f 


p. o vr? 
1 * 

' J 1 1 


SEP 1 7 1985 


August 1985 


I /iliCLD KL SEARCH CliNTCR 
L’ERAHr, NASA 
N/MPTON, VIRGINIA 


NASA 

National Aeronautics and 
Space Administration 



NF00533 






NASA Technical Memorandum 86731 


Qualification Needs for Advanced 
Integrated Aircraft 


Dale A Mackall 

Ames Research Center, Dryden Flight Research Facility, Edwards, California 


1985 


NASA 

National Aeronautics and 
Space Administration 
Ames Research Center 
Dryden Flight Research Facility 
Edwards, California 93523 




A9T- 33//? 



QUALIFICATION NEEDS FOR ADVANCED INTEGRATED AIRCRAFT 


Dale A. Mackall* 

NASA Ames Research Center 
Dryden Flight Research Facility 
Edwards, California 


Abstract 

In an effort to achieve maximum aircraft per- 
formance, designers are integrating aircraft 
systems. The characteristics of aerodynamics, 
vehicle structure, and propulsion systems are 
being integrated and controlled through embedded, 
often flight-critical, electronic systems. This 
paper addresses the qualification needs for such 
highly integrated aircraft systems. Based on 
flight experience with research aircraft, a set 
of test capabilities is described which allows 
for complete and efficient qualification of 
advanced integrated aircraft. 


Nomenclature 


DEEC 

digital electronic engine 

control 

DEFCS 

digital electronic flight 

control system 

EMD 

engine model derivation 


EMI 

electromagnetic interference 

FMET 

failure modes and effects 

testing 

HIDEC 

highly integrated digital 

engine control 

ISA 

integrated servoactuator 


ITF 

Integrated Test Facility 


LVDT 

linear variable displacement transducer 

RPRV 

remotely piloted research 

vehicle 

STOL 

short takeoff and landing 



Introductio n 

From the first integrated system program, the 
YF-12 cooperative control program, to the most 
recent, the X-29 forward-swept wing program, the 
trend in aircraft research at the Ames Research 
Center, Dryden Flight Research Facility has been 
to control the previously adverse or undesirable 
interactions between subsystems to improve per- 
formance. At certain flight conditions the YF-12 
propulsion system’s bypass door operation had con- 
siderable undesired control authority.! By using 
the undesired bypass door effect through proper 
electronic control, the flightpath performance of 
the aircraft was improved by a factor of 10. The 
X-29 digital flight control system allows the 35- 
percent staticly unstable aerodynamic configura- 
tion to fly with level 1 flying qualities. 

*~Ae _ ronTiTTFca 1 Eng i ne er, Mem b e r A I A A 


The use of digital electronic control systems 
to take advantage of the undesirable or unique 
characteristics of an aircraft system has led to a 
new class of advanced integrated aircraft. A 
leading issue in the development of this new class 
of aircraft is the complete and efficient testing 
or qualification of the aircraft's systems and 
performance. The improved performance obtained by 
the integration places an equivalent increase 
in flight criticality for the avionics that accom- 
plishes it. Full -authority flight control for 
staticly unstable airframes is a prime example. 

More avionics systems, such as the weapon systems 
in an integrated flight-fire control system, are 
becoming flight safety related. The need to 
assure safe and efficient flight testing for this 
new class of aircraft places new requirements on 
the test capabilities for aircraft qualification. 

There are many steps in qualifying an aircraft 
for flight, however, this paper addresses only the 
validation of the design to a system performance 
specification, once all the subsystem testing has 
been completed. This testing is to validate the 
performance of a design, and is not intended to 
show proper implementation. "Integrated systems 
aircraft" is defined and the requirements for 
testing this type of aircraft are discussed. Such 
requirements include testing capabilities, and the 
type of facility in which to perform the tests — 
namely, the proposed NASA Ames-Dryden Integrated 
Test Facility. 

Integrated Systems Aircraft 

Popular new terms over the past few years 
include the "integrated systems aircraft" and 
"synergistic design." To the degree possible, 
every aircraft has used the individual components 
of its design to provide a cooperative, effective 
total system (synergism), given the technology 
available at the time. Today's highly integrated 
aircraft are uniquely characterized by (1) the 
extent to which the aircraft disciplines or sub- 
systems are combined, and (2) the use of embedded 
digital control systems to accomplish the integra- 
tion. The primary distinction from the past is 
the flight safety dependence of the integrations. 

System integration can be categorized as 
either functional or subsystem integration. 
Functional integration occurs when basic aircraft 
disciplines, such as aerodynamics, structures, or 
propulsion, are blended through a control system 
to provide new or improved functions. Examples of 
functional integrations include staticly unstable 
airframes requiring full authority control systems, 
the structural integration providing maneuver-1 oad 
control and flutter-suppression systems, and 



maneuverability and performance gains expected 
from integrated propulsion control. 

Two aircraft currently in flight test at 
Ames-Dryden in the functionally integrated cate- 
gory are the X-29 forward-swept wing and the F-15 
aircraft being used for the highly integrated dig- 
ital engine control (HIDEC) program. 2 Figures 1 
and 2 show an overview of the X-29 aircraft and 
its digital flight control system. Figures 3 and 
4 give an overview of the HIDEC systems. Primary 
interactions in the X-29 aircraft are between the 
aerodynamics (35-percent staticly unstable), the 
structure, and the flight control system. The 
HIDEC is investigating interactions between the 
flight control and propulsion control systems. 
Reference 3 provides an excellent review of inte- 
grated systems aircraft worldwide. 

Subsystem integration results from the imple- 
mentation of the systems that achieve the func- 
tional integration. Subsystems include electrical 
power, actuation and hydraulics, pilot displays, 
avionics, and, in the case of the military, weapon 
systems. Ful 1 -authority flight control requires 
the integration of an electrical system to provide 
full-time, safety-critical power to the control 
system. Similarly, the flight control system must 
be interfaced to the actuation system in a manner 
that is tolerant to faults. These interfaces, or 
subsystem integrations, are a direct result of the 
demands placed by the functional integration to 
control a staticly unstable airframe. Another 
type of subsystem integration is information 
fusing or resource sharing. This resulted from 
the use of digital avionic systems and their data 
bus architectures. The air data computer can pro- 
vide data to the flight control system, navigation 
system, weapon system, and pilot's displays. Raw 
data and calculated results can be shared by 
various subsystems. 

Integrated systems aircraft can be defined as 
those that achieve a significant performance gam 
through functional integration. The functional 
integrations often use undesirable interactions in 
a controlled, beneficial manner, making the loss 
of the control system unacceptable and often 
unsafe. 

Flight experience with the earliest integrated 
systems aircraft, those with digital flight con- 
trol systems, has uncovered several unique anoma- 
lies that help identify areas where integrated 
testing capabilities are needed. These anomalies 
i nclude 

1. Limit-cycle oscillations caused by differences 
between the iron-bird simulation and the aircraft 
actuator hysteresis. Inclusion of the actual 
aircraft systems during ground test would have 
avoided this flight anomaly. 

2. Loss of two out of three digital flight con- 
trol channels. This was caused by many factors, 
sensor noise and asynchronous channel operation 
being primary. The problem was undetected during 
ground test because of inadequate models of sensor 
noise and because exact conditions of failure were 
not in the test matrix. 


3. Rudder oscillation with frequency proportion- 
ate to engine rpm. The flight control lateral 
accelerometer detected engine vibrations and fed 
the control laws. Inclusion of the flight vehicle 
with the engine operating during ground test would 
have avoided the flight anomaly. 

4. Rapid flight control mode changes caused by an 
avionics system failure. Problem was not repeat- 
able, and the cause was never found. This serious 
integration problem (the rapid flight control mode 
changes caused by the avionics system failure) 
suggests that improved test efficiency could have 
avoided the flight anomaly. 

5. Unexpected inability to lower landing gear in 
a remotely piloted vehicle, caused by failure of 
one of two uplink command receivers. Multiple 
hardware and software changes, coupled with inef- 
ficient failure modes and effects retesting, 
allowed anomaly. 

This partial list of anomalies, along with 
other flight experience, indicates the need for 
integrated systems testing. The capabilities 
described in this paper are currently in various 
stages of development, all are believed to be 
needed for successful qualification of integrated 
systems aircraft. 

Integrated Systems Testing 

Integrated systems aircraft require integrated 
systems testing, in addition to the standard indi- 
vidual component testing that is performed on con- 
ventionally designed aircraft. Table 1 lists the 
types of integrated system tests and provides a 
few examples of component tests for comparison. 
This section defines integrated system testing, 
the environments necessitated by it, and how this 
testing relates to a particular integrated systems 
appl ication. 

One aspect of integrated system testing that 
makes it unique from other testing is the environ- 
ment or configuration that is needed. Experience 
at the Dryden Flight Research Facility has shown 
that all the interacting systems must be operating 
together, in an environment that best represents 
flight, to successfully test an integrated systems 
aircraft. Required are the embedded digital con- 
trol system, the airframe, the aircraft sub- 
systems, and the propulsion system. Where aspects 
of the flight environment or configuration are not 
possible, detailed simulation models must be 
included. Typically, the aircraft aerodynamics is 
a primary model , along with the propulsion system 
model. Depending on the particular application 
and such items as the availability of the air- 
frame, other models may also include the actua- 
tors, airframe structural modes, maneuvering 
target aircraft, threats, and perhaps the inte- 
grated control algorithms. Figure 5 shows an 
example of an aircraft in the aerodynamic loop 
configuration, and Fig. 6, a hot-bench configura- 
tion that utilizes the flight electronics hardware 
only. The hot-bench configuration uses more 
models than the ai rcraft-i n-the-1 oop configura- 
tion, and the aircraft subsystems, such as the 
electrical system, are not included. Six cate- 
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gones of integrated system testing are described 
in the following sections. 

Fai lure Modes and Effects Testing 

Failure modes and effects testing (FMET) 
assures that the integrated control system design 
identifies failures and reconfigures the system 
correctly in response to those failures. Because 
of the criticality of the system, redundant, 
faul t-tolerant hardware designs are required. 
Triplex and quad redundancy are used for most 
digital flight control systems. FMET validates 
the performance of the fault tolerant design. 

Unlike failure modes and effects analysis 
which examines the system design to determine 
failure paths leading to loss of control, FMET 
tests the real hardware operating the flight soft- 
ware. FMET determines the effects of single 
failures as well as combinations of failures that 
can lead to loss of control. The fault detection, 
identification, and reconfiguration of failures 
have been accomplished within the flight software, 
making the software an essential part of any 
failure modes evaluation. In integrated sub- 
systems aircraft, FMET also assures that failures 
of a subsystem are contained within its allowed 
boundaries . 

FMET is performed by inducing simulated 
failures in sensors, computer components, com- 
munication links, the actuation system, and pilot 
displays, and then evaluating the effects. 

Effects are evaluated in terms of the impact on 
reliability, the proper detection and reconfig- 
uration by the system, and the stability and 
control performance of the reconfigured system. 
Depending on the component being failed, several 
failure modes are examined. Null, hard-over, 
ramp, and bias failures are typical failure modes 
exercised for sensor inputs. FMET is usually non- 
destructive testing, with failure modes being 
simulated or induced over nominal values. 

Stabi l ity and Control Test ing 


Any physical system, whether it be an 
aircraft, a structure, an engine, or any com- 
bination of the three, that has its basic charac- 
teristics modified through the use of an active 
control system, must be tested for adequate stabi- 
lity and control throughout its development. 
Testing requires a closed-loop conf 1 gurat ion to 
determine proper responses to step inputs, fre- 
quency sweeps, and pilot commands. Table 2 lists 
the typical stability and control tests and the 
criteria examined for a successful test. The 
integrated system configuration of this test is 
performed with the aircraft in the loop so that 
all the system nonl mean ties of flight are pre- 
sent, and to uncover any unexpected interactions 
that may exist. Test comparisons are made to the 
stability and control tests which are done during 
development of systems that use linear models. 

EJj?c tromagneti c Interferenc e Testing 

Electromagnetic Interference (EMI) testing is 
performed to determine any undesirable effects one 


subsystem may have on another because of electro- 
magnetic interactions. Because of the amount of 
electronic equipment and possible modes in which 
the equipment can operate, the EMI test matrix can 
grow very large. Testing all the possibilities in 
an integrated systems aircraft, where a large num- 
ber of the electronic components are required for 
safe flight, becomes a difficult task. To date, 
EMI testing has not been performed with the aero- 
dynamics loop closed around the control system 
because the flight control system has been a dedi- 
cated system without a large number of critical 
interfaces to other systems. In addition, a con- 
siderable amount of testing is performed with the 
engine operating, making closed-loop operation 
di fficult. 

Integrated systems testing for el ectromagnetic 
interference will require more effort to complete, 
to assure that the critical electronic components 
are compatible for all their operating modes. The 
capability to perform the tests with the engine 
running and the aerodynamic loops closed around 
the control system is needed. 

Integration Effects and Sensitivity Testing 

Integration effects and sensitivity testing is 
a unique category for integrated systems aircraft, 
which concentrates on evaluating the performance 
effects of the integrated design and what sensi- 
tivity the performance may have to changes in 
various parameters. Each integrated system design 
is unique therefore, the actual testing and para- 
meters involved will vary. However, when two pre- 
viously independent systems become reliant on each 
other, their effects on and sensitivities to each 
other must be determined. In an integrated 
flight-fire control system, the stability and 
control effects that the fire control system has 
on the flight control system must be evaluated 
with all systems interacting. The fault-tolerant 
performance of the overall system must also be 
evaluated and the sensitivity to different failure 
modes defined. 

An example of a digital flight control sensi- 
tivity test is determining the effects of changes 
in the effectiveness of the control surfaces on 
stability and control characteristics. This test 
is done to evaluate the effects of model uncer- 
tainties on performance. 

Mission Evaluations 

Mission evaluation tests are identified by the 
fact that the pilot is evaluating the integrated 
aircraft systems' performance. Evaluations are 
made for flying qualities, displays, and pilot 
controls. Testing includes both failure-free 
operation and operation with failures induced. 
Integrated flight-fire control evaluations may 
include gross acquisition, tracking, and fragment 
avoidance after weapon release. An integrated 
propulsion control system for short takeoff and 
landing (STOL) would require piloted evaluations 
of landings and engine-out performance. As the 
system matures, the mission evaluations are used 
to assure that flight test points are evaluated on 
the ground before actual flight testing. This 
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provides the double service of pilot training, and 
of detecting any unexpected anomalies that may be 
latent in the system, surfacing when certain con- 
ditions arise. 

Mission evaluations are a subset of the pre- 
vious three tests, performed with a pilot, in the 
environment that best represents flight. 

Reval idation 

Throughout the final development and flight 
test of any control system, changes are made to 
make improvements and correct discrepancies. 

Figure 7 shows the discrepancies and corresponding 
software changes made on one of the Ames-Dryden 
research aircraft. Any system, whether research, 
military, or commercial, will eventually be sub- 
ject to change. Integrated systems aircraft, 
because of their interactive nature, require care- 
ful reval idation of the system for changes made to 
any of the subsystems. The five tests described 
previously must be scrutinized to define a suf- 
ficient subset of tests that requalify the 
aircraft. 

FMET is frequently rationalized as not needed. 
It is the most difficult and time-consuming test 
to perform, and the probability of a failure in a 
given flight is comparatively low. The critica- 
lity of the integrated systems aircraft requires 
that FMET be a part of the revaluation effort, 
otherwise, single failures will cause unexpected, 
perhaps disastrous, results. The inability to 
lower the gear in the remotely piloted vehicle 
cited earlier could have been avoided if FMET had 
been performed after changes were made. 

Capabilities to Improve Completeness 
and Efficiency 

Capabilities for complete and efficient test- 
ing of integrated systems aircraft are needed to 
support both j'mtial qualification and flight test 
operations. Complete testing is required because 
of the criticality the systems have, and the need 
to assure safe flight test. Test efficiency is 
needed to accomplish the increased amount of test- 
ing required before flight test and to minimize 
the downtime for resolving discrepancies dis- 
covered during flight test. Completeness and 
efficiency are closely related. Given a set time 
frame, test efficiency will allow more testing to 
occur, improving completeness. 

The test matrix (and therefore the number of 
test conditions) grows exponentially as the num- 
ber of interdependencies increases. Aircraft sta- 
bility and control has always been dependent on 
the aerodynami cs , but has now become dependent on 
the control algorithms, the weapon systems, and 
the propulsion system characten st ics (such as 
vectored thrust). These new dependencies increase 
the amount of testing needed. The rationale for 
complete and efficient testing, along with the 
desired capabilities to accomplish them, are shown 
in Table 3. To achieve completeness requires pro- 
viding capabilities for increased understanding of 
the system being tested for determining proper 


test matrices, for increasing the visibility into 
the system, and for reducing the number of model- 
ing errors through more efficient use of flight 
equipment. To achieve efficiency requires auto- 
mating the test process, centralizing the test 
information, providing for quick test setup, and 
allowing for easy isolation of interactive systems 
for troubleshooting. 

Test Completeness 

Documentation of the flight hardware, the 
software operating in each flight computer, signal 
interfaces, and the functional design are all 
needed to perform integrated systems testing. 

This documentation is currently only available in 
hard copy form, often weighing more than one per- 
son can carry. The need for an online description 
of system operation has been shown by such simple 
examples as word processing software for personal 
computers which have online help functions. Plac- 
ing a system description for a control system in a 
flight computer would not be appropriate, but a 
system description must be available to the test 
engineer. Armed with a complete system descrip- 
tion, the test engineer can wisely choose test 
matrices, determine test parameters to monitor, 
and be in a better position to resolve discrepan- 
cies that occur during testing. 

The integrated systems aircraft gives the 
potential of having problems surface in areas 
that are not being tested directly. Testing a 
high-current device that loads the electrical 
bus could affect the operation of any one of the 
embedded flight computers through EMI. The exten- 
sive use of embedded flight computers also means 
that a majority of the system integration is being 
done by the software. Instrumentation of the 
system under test means that one must monitor the 
different integrated systems, hardware and soft- 
ware, and the aircraft subsystems during test 
operations. Instrumentation of the software must 
be considered early in the design to provide 
access to internal calculations at the rates 
needed. 

Modeling deficiencies can consist of the lack 
of models for system interactions not believed to 
be important, as well as uncertainties in models 
for such things as aerodynamics or the propulsion 
system. The inability to know and model all the 
interfaces and interactions that exist between the 
aircraft subsystems has lead to the inclusion of 
the aircraft and its flight equipment in the test 
environment. For example, a control algorithm 
written in FORTRAN and operating on a mainframe 
computer would have different characteristics from 
a flight version. The effect of those differences 
on system performance is difficult to identify. 

The easiest solution to the problem is the inclu- 
sion of the flight hardware when performing tests. 
This system "burn-in" is essential for detecting 
interface problems and achieving maturity in the 
design. 

When qualifying integrated systems aircraft, 
the model of the operating environment must be 
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carefully considered to determine its effects 
on the system. Environmental factors primarily 
include vibration, temperature, and for piloted 
simulations, the visual display. Placing an 
entire aircraft in an environmental chamber cap- 
able of thermal cycling and three axis vibration 
is not feasible, therefore, the effects of these 
factors must be modeled during testing. Vibration 
can be modeled by imposing noise on top of sensor 
values and by testing with the engine operating. 
Temperature effects must be measured for sensors 
and actuators and the appropriate sensitivity 
testing performed. Hot-bench testing allows the 
flight hardware to be operated within a thermal 
chamber and the aerodynamic loop closed around the 
flight control system. 

The piloted simulation tasks of mission eva- 
luations require a complete and coordinated set 
of visual and instrument displays. Integrated 
systems aircraft are using head-up displays, digi- 
tal maps, and multifunctional displays as primary 
pilot instruments. These visual displays, coupled 
with the out-the-wi ndow display, must present a 
coordinated, realistic flight environment to the 
pilot. To allow testing with the aircraft in the 
loop, and to drive the visual displays, requires 
special considerations during the design of the 
ai rcraft. 

Test Efficiency 

Increasing test efficiency provides the time 
to perform the complete testing needed to qualify 
integrated systems for flight test. Test effi- 
ciency also reduces flight test cost by minimizing 
the downtime associated with identifying and 
resolving di screpanci es from flight test. With 
test costs for digital flight control system 
qualification running as much as $1 million a 
month on a given program, improving test effi- 
ciency is essential. 

Automating the test process is the first step 
in improving test efficiency. To do this one must 
first examine the steps performed when conducting 
a test. They include (1) writing the test proce- 
dures, (2) initiating and monitoring the test, (3) 
analyzing the results for test success, and (4) 
displaying and documenting the results. Table 4 
compares the current manual approach of testing to 
an automated approach. By putting the simulation 
and flight systems under control of the automated 
test system, all the test steps can be interac- 
tively controlled by the test engineer. The auto- 
mated test system requires data base management 
and analysis software, along with graphical dis- 
plays and hard copy documentation — all possible 
with today's engineering work stations. With the 
automated test system, the number of tests per- 
formed and the number of parameters that can be 
monitored and analyzed is not limited by the time 
available for testing but by the computational 
power of the test system. 

One obstacle to efficient test operations has 
been the lack of centralized control and display 
of test data. Simulation data and operational 
control have not been available at the aircraft, 


and only minimal aircraft data were available at 
the simulation. Control of the aircraft systems 
was done entirely at the vehicle. A major goal of 
the automated test development is to rectify the 
problem by bringing together the aircraft and the 
simulation operations at one central test station. 
Synergistic flight vehicles require a synergistic 
approach to their qualification. 

Flight Test Support 

In addition to all the above capabilities, two 
unique capabilities are needed to support the 
integrated systems aircraft during flight test. 
Flight test anomalies of this type of aircraft 
must be thoroughly understood, resolved, and 
corrected in as short a time as possible to keep 
flight test cost down. Thoroughly understanding a 
problem and providing quick turnaround have not 
been easily accomplished in the past, as the goals 
tend to be mutually exclusive. Two capabilities 
will help the situation. First is to allow for 
quick setup of the aircraft with the simulation so 
that the conditions of the anomaly can be repro- 
duced quickly. Second is to allow isolation of 
the interactive subsystems so that the effects of 
a failing subsystem can be separated from those 
induced by its interactive partners. In an 
integrated propulsion-flight control system, this 
would provide the ability to easily test flight 
control and propulsion control independently, then 
combine them for integrated testing. This capabi- 
lity would require that the test system have 
control over the aircraft systems, and that the 
necessary aircraft interfaces be provided. 

Each of the capabilities discussed have some 
application to the different integrated systems 
tests. Depending on the particular integrated 
systems aircraft design and the specific test, 
certain capabilities will prove to be more 
valuable than others. For example, mission eva- 
luations which require piloted simulation cannot 
be automated to the extent of a stability and 
control test, in which a specific test is repeated 
at numerous different flight conditions. 

In summary, it is believed that the develop- 
ment of these capabilities will provide for effi- 
cient and complete qualification of the integrated 
systems aircraft flying now and in the future. 

Application to Failure Modes 
and Effects Testing 

Failure modes and effects testing for a typi- 
cal digital flight control system is examined to 
show how the integrated systems test capabilities 
can be applied. Several factors must be con- 
sidered when determining FMET cases for digital 
control system, including aircraft state, device 
to be failed, failure mode, and pilot inputs 
(Table 5). This results in a four-dimensional 
matrix of possible test combinations, impossible 
to thoroughly test manually. In designs where the 
control law characten sti cs are not decoupled from 
the fault-detection logic, changes in aircraft 
state, such as Mach number and altitude, will 
change control law gains and affect the perfor- 
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mance of the fault-detection logic. Test matrices 
of a million test cases are easy to obtain. 

Certain capabilities are needed to perform 
even the basic FMET cases. They include having 
the real flight equipment under test and having 
the flight systems thoroughly instrumented. Two 
of the test capabilities are especially suited to 
address the problem of the large test matrix 
online system description and test automation. 

Reducing an FMET test matrix is very difficult 
because there is always the chance that an unex- 
pected interaction will cause a single failure to 
develop into something more serious. However, by 
using an online system description that has been 
verified as accurate by previous subsystem 
testing, a test engineer can make intelligent 
choices when determining the validity of a test 
case. The online description must allow one to 
query the design data to determine whether rela- 
tionships exist between test conditions and sub- 
systems. This has been accomplished to a limited 
extent on one flight program. Advances in com- 
puter science provide several approaches to the 
online data-base capability; they include rela- 
tional data-base management systems and artificial 
l ntel 1 igence. 

The second capability, test automation, shows 
great promise for handling the test matrices of 
FMET. The earliest stages of test automation for 
FMET were during the F-8 digital fly-by-wire 
program in the midseventies. Sensor redundancy 
management software in the flight control com- 
puters was tested using an automated test pattern 
that feeds each of the triplex sensors. All 
aspects of the software were exercised by a 
35-second sequence (Fig. 8). Analysis of the 
results required transferring of data tapes and 
visual inspection, however, the time needed to 
qualify the software was greatly reduced. By con- 
centrating the test data and by automating the 
entire test process from test initiation through 
analysis and documentation, it is expected that 
large FMET matrices can be completed in an accep- 
table time frame. 

The Integrated Test Facility 

The Integrated Test Facility (ITF, Fig. 9) is 
a newly proposed facility to be located at Ames- 


Dryden. The facility would house several existing 
functions, as well as provide for some new func- 
tions necessary to qualify integrated systems air- 
craft. The ITF brings together the aircraft, sim- 
ulation systems, and engineering staff, providing 
a unified test environment. A layout of the faci- 
lity is shown in Fig. 10. Included is hangar 
space and aircraft services to support up to six 
aircraft. Three hangar bays can also be con- 
figured to house one larger aircraft. The center 
section of the building houses the simulation 
systems, placing them in close proximity to all 
six hangar test bays. The engineering staff is 
located in the front of the building, with ample 
room for visiting contractors who support the 
flight test programs. The facility would support 
classified programs. 

By providing the ability to operate all the 
aircraft systems in the test environment, the ITF 
would provide the capabilities necessary to 
qualify integrated systems aircraft. 

Concluding Remarks 

Flight test experience with early integrated 
systems aircraft has shown the difficulty and cost 
of qualifying and flight testing this new class of 
aircraft. New capabilities must be developed to 
qualify the integrated systems aircraft to avoid 
delayed developments and increased risk during 
flight test. The Integrated Test Facility and 
test capabilities described herein are being deve- 
loped to assure continued progress in the flight 
test of aeronautic programs. 
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Table 1 Integrated system and component tests 


Integrated systems tests 
Failure modes and effects 
Stability and control 
Electromagnetic interference 
Integration effects and sensitivity 
Mission evaluation 
Reval idation 
Component tests 
Hardware tests 
Temperature 
Vibration 
Humidity 

Hysteresis (actuators) 

Noise (sensors) 

Software tests 
Code examination 
Unit tests 

Total product testing 
Hardware and software interface testing 


Table 2 Stability and control tests and criteria 


Test 


Type 


Criteria 


Step response 

Frequency response, 
closed loop 
Frequency response, 
open loop 

Static gains 


Time domain 
Frequency domain 
Frequency domain 

Time domain 


Frequency and damping 
of response 

Gain margins, phase 
margins 

Comparison of flight 
code to development 
models 

Comparison of sensor to 
surface gains to 
development models 


Table 3 Capabilities needed for complete, efficient testing 


Completeness 


Efficiency 


Rationale — 

Criticality of systems, safety 
Minimize flight test anomalies 

Capabi 1 lties — 

Online system description for 
a thorough understanding of 
system under test and deter- 
mining proper test matrices 
Instrumentation of systems 
under test to see detailed 
response to stimulus 
Inclusion of real equipment 
to minimize modeling errors 
Providing detailed models of 
the systems' operating 
envi ronment. 


Rationale — 

Increasing size of test matrix 
needed to qualify system 

Minimize downtime during flight 
Capabi 1 i ti es — 

Automation of the test process 
Performing test cases 
Analysis of Results 
Documentation 

Centralized control and display 
of test data 

Quick setup of aircraft systems 
for analysis 

Isolation of individual inter- 
related systems for trouble- 
shooting. 
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Table 4 Comparisons of current manual test approach 
to an automated approach 


Test phase 

Current approach 

Automated approach 

Develop test 
procedures 

Write verification and 
validation tests 
Identify test configuration 
Identify test parameters 
(recorded on paper) 

Write test reports 
Identify test configuration 
Identify test parameters 
(stored in computer) 

Test setup 
and execution 

Manually change configuration 
Physically perform test 
procedures 

Execute procedures 
electronically 

Monitor test 
results 

Monitor strip charts, lights, 
and simulation displays 
Information physically 
distributed 

Central monitoring of all 
predetermined data 
Flexible formats, graphics 
displays 

Analyze test 
results 

Analyze strip charts and 
listings after testing 

Near real-time analysis of 
test data 

Create 

documentation 

Assemble test forms, copy 
strip charts, attach 
listings, explain results 

All pertinent data 
maintained by data base 


Table 5 Factors in defining 
an FMET matrix 


Aircraft states, including 
Mach number 
Altitude 
Inertial rates 
Landing gear position 
Weight on wheels 
Devices, including 
Electrical power 
Interial sensor 
Rate gyro 

Analog/digital converter 
Memory 

Actuator command link 
Display 

Failure modes, including 
Random noise 
Hard over 
Ramp 

Oscillatory 

Null 

Pilot inputs, including 
Pitch stick 
Trim 

Mode selection 
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Air data system Sensor system 


- Camber 
control 


• Angle of attack 


• Side slip 

Accelerometers 

• Static and 

and 

impact pressures 

rate gyros 

• Total temperature 




Control 

stick 



Strake 

flaps 


(ISA) Integrated servo actuator 


- Throttle 
control 


Fig, 2 X-29 flight control system • 



Fig , 3 Features of the F-15 HI DEC research airplane , 
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Fig . 4 Block diagram of the HIDEC system . 



Integrated systems testing 

- Structural coupling 

- Stability and control 

- Failure modes and effects testing 

- Emergency procedures development 

- Mission simulation 

- Flight test planning 
Flight test support 

- Discrepancy analysis 

- Retest changes 


Control systems - 


Aircraft in the loop 


Fig. 5 Aircraft-in-the-loop configuration * 
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Simulation 

computer 



Fig • 6 Hot -bench simulation • 
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Fig . 7 History o.f discrepancies and changes for 
an integrated systems aircraft • 
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A 


Normalized 
input A 


Typical test burst 
for N =5 case 


Test segments 




Normalized 
input C 


Normalized 

output 


Counter A 
level 



Counter B 
level 


Counter C 
level 



Elapsed time, sec 


Fig. 8 Automated test sequence for sensor inputs . 
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